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(57) ABSTRACT 

A system and method are disclosed for gathering informa- 
tion relating to a loading time experienced by a user of 
information over a network. A browser agent is sent to a user 
machine in response to a user request to access a Web page. 
The browser agent initiates the sending of a user HTTP GET 
request and the browser agent is operable to log a first time 
corresponding to the sending of the user HTTP GET request. 
The browser agent measures a download time interval that 
is determined according to the difference between the first 
time and a second time corresponding to the loading of the 
web page. The browser agent is operative to cause the user 
machine to send a modified HTTP GET request, wherein the 
modified HTTP GET request contains a performance param- 
eter indicative of the measured download time interval. 
Thus, the download time interval experienced by the user is 
measured and a parameter indicative of the measured down- 
load time interval is sent as part of the modified HTTP GET 
request 
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METHOD AND APPARATUS FOR measure actual download times experienced by users and 

EVALUATING SERVICE TO A USER OVER use that data to evaluate network performance. It would be 

THE INTERNET useful if such a system were capable of receiving instruc- 
tions to measure performance and transmit results without 

RELATED APPLICATION 5 violating network security constraints. The system should be 

Tlie present application is a continuation of U.S. patent fV M *> for exam P le * of transmitting data from behind a 

application Ser. No. 08/868,616, filed Jun. 3, 1997, now U.S. nrewa11 - 

Pat. No. 6,006,260. SUMMARY OF THE INVENTION 

BACKGROUND OF THE INVENTION 10 Accor dingly, the preS ent invention provides a system that 

1. Field of the Invention causes a user to measure the download time of a web page 

~ ♦ • 1. 11 * *u j j experienced by the user accessing the web page. The data is 

The present invention relates generally to methods and \ c lL . 1 iL . r . 1 « • 

S , " . . ° y ~? T * 7 sent from the user to a relay server that preferably combines 

apparatuses for evaluating service to a user over the Internet, t . f , . U . J - / . 4 . 

^ © ^ the performance data with geographical mformation relating 

More specifically, the invention relates to methods and 15 t0 the user ^ data can men be combined ^th data 

apparatuses for determining at a user site the amount of time obtained from other users and stored in a central database for 

that certain operations take over the Internet, providing processing. 

information regarding the timing to a relay server and, in . , A . rt • 4 A 4 . . , u 4 . t . , 

• ■ • , & 1 - • *u * • • c I- It should be appreciated that the present invention can be 

certain embodiments, combining the timing information , ♦ j ■ • 1 ^ 

... . r t . ,1. t*cL .1 , • . 1 implemented m numerous ways, including as a process, an 

with information that identifies the user s geographical 20 r ^ . . J ' 5 r ' 

location apparatus, a system, a device, a method, or a computer 

readable medium. Several inventive embodiments of the 

2. Description of the Related Art preseQt inveation are described below. 

With the explosive growth of the Internet, increased traffic In one embo diment, a method of gathering information 

has caused the performance experienced by users making relating t0 a loading time experienced by a user of infor- 

connections over the Internet to vary widely. Many factors mation over a network ^ disclosed . The method includes 

can influence the performance of a connection including the a browser agent tQ a user machine m reS ponse to a 

user's modem and other equipment, the type of server, the user request t0 access a web page browser t 

load on the server, and the Internet service provider used. me sen din g of a user HTTP GET request and the 

The first step in evaluating connection performance is to browser agent ^ operable to log a first time corresponding 

obtain reliable information regarding performance charac- t0 the of the ^ Hrrp G£T f t ^ browsef 

teristics such as the time required to download web pages or agent measures a download time interval that is determined 

other information across a connection It is also important to accord ing to the difference between the first time and a 

measure network performance relating to connection less secand time correS p 0nding t0 the loading of the web page . 

protocols such as UDP. ^ browser agent is operative to cause the user machine to 

Currently available methods of measuring download send a modified HTTP GET request, wherein the modified 

speeds at different sites and collecting that information in a HTTP GET request contains a performance parameter 

database that facilitates analyzing the information include indicative of the measured download time interval. Thus, the 

attempting to measure performance on the server side (that download time interval experienced by the user is measured 

is, on the server that is providing the web pages or other 4Q and a parameter indicative of the measured download time 

information requested by users) or providing a network of interval is sent as part of the modified HTTP GET request, 

special machines that are programmed to connect to differ- In another embodiment, a system for assembling perfor- 

ent web sites as clients and evaluate the performance of the mance data relate d to the downloading of information from 

connection. The special machines that make up the network a computer network is disclosed. The system includes a web 

can then store or report their connection results. 45 sernt configured to send a browser agent to a user in 

The main drawback of analyzing connection performance response to a user request. The browser agent is operable to 

on the server side is that the performance experienced by log a first time corresponding to the sending Of a user HTTP 

users is not fully determinable from the measurements made GET request and the browser agent is configured to initiate 

at the server. The server can, of course, determine when the sending of the user HTTP GET request The browser 

packets are sent out and received, and such information 50 agent is also configured to measure a download lime interval 

measures the responsiveness of the server i.e., how quickly that is determined according to the difference between the 

the server sends a response once a request is received. The first time and a second time corresponding to the loading of 

responsiveness of the server, however, does not fully deter- me web page. A relay server is configured to receive from 

mine the downloading time that is experienced by the user. the user a modified HTTP GET request The modified HTTP 

Similarly, a special testing machine can provide accurate 55 GET request contains a performance parameter indicative of 

information about the downloading time experienced by that the measured download time interval. Thus, the download 

machine, but it is not possible to ascertain downloading time interval experienced by the user is measured and a 

times experienced by actual users whose hardware or soft- parameter indicative of the measured download time interval 

ware configuration may differ from the configuration of the is received as part of the modified HTTP GET request, 

testing machine or who request information at a different 60 In another embodiment, a system is disclosed for assem- 

time. Furthermore, special testing machines do not provide bling performance data related to the downloading of infor- 

information about actual historical user connections that can mation from a computer network. The system includes a 

be analyzed after a problem has been reported. we b server configured to send a browser agent to a user in 

What is needed is an apparatus and method for testing response to a user request to access a web page. The browser 

network performance that can unobtrusively acquire, collect 65 agent is operable to log a first time corresponding to the 

and organize data relating to network performance from sending of a user HTTP GET request and the browser agent 

actual users. It would be useful if such a system could is configured to initiate the sending of the user HTTP GET 
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request. The browser agent is also configured to measure a have not been described in detail in order not to unneces- 

download time interval that is determined according to the sarily obscure the present invention, 

difference between the first time and a second time corre- piG. 1A illustrates an example of a computer system that 

sponding to the loading of the web page. The browser agent may be used to execute the software of an embodiment of 

is configured to send a modified HTTP GET request that 5 the present invention. FIG. 1A shows a computer system 1 

contains a performance parameter indicative of the mea- which includes a display 3, screen 5, cabinet 7, keyboard 9, 

sured download time interval. Thus, the download time and mouse u Mousc u may havc one or more buttons for 

interval experienced by the user is measured and a parameter interacting with a graphical user interface. Cabinet 7 houses 

indicative of the measured download time interval is sent s a CD-ROM drive 13, system memory and a hard drive (see 

part of the modified HTTP GET request. 10 piG. IB) which may be utilized to store and retrieve 

Those and other features and advantages of the present software programs incorporating computer code that imple- 

invention will be presented in more detail in the following ments the present invention, data for use with the present 

specification of the invention and the accompanying figures invention, and the like. Although the CD-ROM 15 is shown 

which illustrate by way of example the principles of the as an exemplary computer readable storage medium, other 

invention. is computer readable storage media including floppy disks, 

tape, flash memory, system memory, and hard drives may be 

BRIEF DESCRIPTION OF THE DRAWINGS utilized. 

The present invention will be readily understood by the FIG - 1B shows a s y stem block diagram of computer 
following detailed description in conjunction with the 20 system 1 used to Execute the software of an embodiment of 
accompanying drawings, wherein like reference numerals l he present invention. As in FIG. 1A, computer system 1 
designate like structural elements, and in which: includes monitor 3 and keyboard 9, and mouse 11. Computer 
FIG. 1A illustrates an example of a computer system that s y stem 1 ^her includes subsystems such as a central 
may be used to execute the software of an embodiment of J! 1 ? 0 ? 801 51 - ^ ™* *'J^ * ^ ^ 
the present invention. 25 d " ve > ^movable disk 57 (e.g CD-ROM drive), display 
Hn , „ adapter 59, sound card 61, speakers 63, and network inter- 
ne. IB shows a system block diagram of computer face 65 0ther mmpul6T systems suita51e for ^ wilh the 

systemusedtoexecutethesoftwareofanembodimentofthe present invention may include additional or fewer sub- 
present invention. systems. For example, another computer system could 
FIG. 1C is a block diagram of a system for measuring include more than one processor 51 (i.e., a multi-processor 
download time of a Web page at a group of client sites. 30 system), or a cache memory. 

FIG. 2 is a process flow diagram illustrating the registra- Arrows such as 67 represent the system bus architecture 
tion process that is executed between a browser and a of computer system 1. However, these arrows are illustrative 
Geoserver. of any interconnection scheme serving to link the sub- 
FIG. 3 is a table illustrating the contents of a typical 35 systems. For example, a local bus could be utilized to 
cookie sent to a user in step 224 of FIG. 2. connect the central processor to the system memory and the 
FIG. 4A is a process flow diagram illustrating a process display adapter. Computer system 1 shown in FIG. IB is but 
running on a Web server, a browser, and a relay server for an exam P le of a computer system suitable for us with the 
timing the downloading of a Web page. present invention. Other configurations of subsystems sult- 
ry *xi * mi * ** c c * i • An able for use with the present invention will be readily 
FIG. 4B is an illustration of a frame set used in an 40 y . 
. j. „ , . m , . n . • ■ i- i * apparent to one of ordinary skill in the art. 
embodiment where a visible agent frame containing links to ^ . , . , ,. 

test pages that may be downloaded. FIG * 1C 15 a block dia gr a m of a system for measuring the 

- . r *u c i-i . ■ « • download time of a Web page at a group of client sites. A 

FIG. 5 is a diagram of the fields contained in an HTTP „„ m u^ ~f _ . • „ -,1^ in ~, a m-> 

PCT i, j «i_ * u u n j * * c j i j number of user machines 102a, 1026, and 102c are con- 

GET header that has been altered to transfer download Qected tQ a Web ^ m , Q ofle embodiment each ^ 

timing information to a relay server. machine faas a Web bfowser appUcation QQ {i that 
FIG. 6 is a process flow diagram illustrating the process supports JavaScript and HTML frames. Browser agents 
implemented on tile browser agent. 10 6 fl , 1066, and 106c are shown implemented on each of the 
FIG. 7 is a process flow diagram illustrating the process user machines. Each browser agent is a collection of Java- 
implemented on the relay server. 50 Script functions embedded within an HTML page. In vari- 
ous embodiments, browser agents are implemented in 
DETAILED DESCRIPTION OF THE JavaScript, Java, or Active. Preferably, browser agents are 
PREFERRED EMBODIMENTS implemented in an apple that may be received as part of an 
Reference will now be made in detail to the preferred HTML page for reasons that are described below in other 
embodiments of the invention. An example of the preferred 55 embodiments, browser agents may also be provided as part 
embodiment is illustrated in the accompanying drawings. of ^ installed browser or a plug-in to a browser that is 
While the invention will be described in conjunction with separately downloaded by a user. 

that preferred embodiment it will be understood that it is not When one of the user machines sends an HTTP GET 

intended to limit the invention to one preferred embodiment. request to Web server 104, Web server 104 responds to the 

On the contrary, it is intended to cover alternatives, 60 request by sending an HTML page that contains a browser 

modifications, and equivalents as may be included within agent once the HTML page containing a browser agent is 

the spirit and scope of the invention as defined by the downloaded into a Web browser running on a user machine 

appended claims. In the following description, numerous that supports JavaScript and HTML frames, the browser 

specific details are set forth in order to provide a thorough agent is used to measure Web page download Liming as will 

understanding of the present invention. The present inven- 65 be described in further detail below, 

tion may be practiced without some or all of these specific Each browser agent 106 sends download timing informa- 

details. In other instances, well known process operations tion to a relay server 110 in the form of an HTTP GET 
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request that is adapted to send data in a predefined format, 
a is described below. Relay server 110 then preferably 
transfers the data to a database server 112. In different 
embodiments, database server 112 is located at the site of the 
Web page provider, at an Internet provider, or at the site of 5 
a download timing service center. It should also be noted 
that database server 112 is combined with relay server 110 
in certain embodiments. In addition to providing download 
timing information, a browser agent can also provide certain 
geographical, configurational, or identification information 1Q 
about the user machine on which it resides. This information 
is obtained during a registration process. 

The registration process is initiated by a user connecting 
to a Geoserver 114. Geoserver 114 requests information 
about the user machine that connects to it and provides the 35 
information for storage on the user machine in the form of 
a cookie. A cookie is a set of data that may be ent in an HTTP 
GET request from a user to the URL that corresponds to the 
cookie. Although Geoserver 114 is shown as a separate 
entity in FIG. 1C, in certain embodiments, Geoserver 114 is 2 q 
combined with relay server 110 and/or database server 112. 

A particularly useful feature included in the download 
liming system shown in FIG. 1C is that all communication 
between the parts of the system is accomplished in a manner 
that allows for the fact that different user machines may be 2 s 
operating behind firewalls with varying levels of security 
constraints. So long as the user machine is able to send 
HTTP GET requests and download Web pages with embed- 
ded Java Script, the user machine can communicate within 
the system. During the registration process, the user pro- 30 
vides information to the relay server and the relay server 
returns the information to the user in a cookie. Storing 
geographical and other user information in a cookie file 
located on the user machine enables the browser agent to 
transmit that information along with download timing infor- 35 
mation and other information generated by the browser 
agent in the form of an HTTP GET request to the relay 
server. The browser agent itself is downloaded as part of an 
HTML page in response to an HTTP GET request from the 
user. 40 

FIG. 2 is a process flow diagram illustrating the registra- 
tion process that is executed between a browser 200 and a 
Geoserver 202. First, in a step 210, a user selects the URL 
for a registration form. The URL is sent in an HTTP GET 
request to Geoserver 202. Geoserver 202 replies to the 45 
HTTP GET request in a step 212 by sending a registration 
form as an HTML form. In certain embodiment, Geoserver 
202 sends a warning to the user if a cookie exists already in 
the HTTP GET request that will be overwritten by the 
registration process. In a step 214, the user selects a country 50 
and sends the selection as an HTTP POST. Next, in a step 
216, Geoserver 202 sends an HTML form to the user that 
requests the user's city and state or city and country and 
domain name. In a step 218, the user enters the city and state 
or city and country and domain name and sends the infor- 55 
mation to Geoserver 202 as an HTTP POST. 

Geoserver 202 checks the user entry and sends the nearest 
location choices to the user as an HTML form in a step 220. 
Location choices are predefined locations that are made 
available to the user for selection. Large cities may have a 60 
number of location choices so that timing may be separately 
measured in the different locations. The user then selects the 
nearest choice in a step 222 and sends the choice as an HTTP 
POST. In sparsely populated areas, a location choice may 
not be necessary and several small cities may be included 65 
together in a single location. In such cases, steps 220 and 
222 may be omitted. Geoserver 202 then calculates or looks 
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up the Agent Station Identifier (ASI) for the location speci- 
fied by the user and sends the ASI as part of a cookie to the 
user in an HTML CODE and a confirmation page. 

The ASI is preferably a latitude and longitude of a 
location. Selecting the ASI from among choices presented to 
the user enables the system to collect data for different 
locations together as desired. By specifying the location in 
latitude and longitude, it is ensured that the locations are 
unique. In a step 226, the user indicates that the process is 
done on the confirmation page and communicates that to 
Geoserver 202 by sending an HTTP GET request. In some 
embodiments, Geoserver 202 then sends back the location of 
the referring page in a step 228. 

FIG. 3 is a table illustrating the contents of a typical 
cookie sent to a user in step 224 of FIG. 2. A cookie is a 
name -value pair in the form name-value. The cookie has a 
specified data structure so that the information transferred by 
the cookie can be recovered. A cookie name 300 identifies 
the cookie. A cookie prefix 302 visually identifies the cookie 
to the user. Users generally have the option of setting their 
browser software to notify them when a cookie is being sent 
and to require confirmation before a cookie is added to the 
user's cookie file. Cookie prefix 302 provides a visual label 
to help the user to decide whether or nut to accept the cookie. 

A latitude 304 and a longitude 306 identify the position of 
the user machine that registered. Latitude and longitude are 
preferably stored in 7 character USGS formal. An Agent 
type ED 308 is used to identify the type of agent that is 
registered and is preferably stored in 2 bytes. In one embodi- 
ment Agent type ID 308 specifies whether the agent is a 
browser based agent or a server based agent. It should be 
noted that server based agents in certain embodiments do not 
need to use cookies since they can access the server machine 
memory. In some embodiments, it is preferred not to store 
the Agent type ID in the cookie and instead to provide it with 
other information in the HTTP GET request header, since the 
user might not know the agent type when he is registering 
with the Geoserver to obtain the cookie. This method is 
particularly useful when it is desired to provide a version 
number as part of the Agent type ID. Since the version of the 
agent that is sent to the user may differ based on the sender, 
this information is put in the HTTP GET request by the agent 
itself, and is not provided by a cookie created upon regis- 
tration. 

A provider ID 310 is defined by a Provider table within 
the Geoserver application. Provider ID's are issued by the 
Geoserver as part of the cookie based on a one-to-one 
mapping between an Internet Service Provider's Domain 
name and a preassigned integer number. A customer ID 312 
identifies the customer. The customer is the Web page 
provider that is having the performance of its Web page 
tested. A Page ID 314 identifies the owner within an orga- 
nization of the specific page that is being tested and is 
defined by the customer. 

In alternative embodiments, the customer ID and the page 
ID are provided in the HTTP GET request instead of in the 
cookie, since they may not be known on registration, but can 
be passed to the user with the browser agent apple. The 
provider ID may also be provided in the HTTP GET request, 
as is described below. 

A sample cookie treated according to the format described 
above is shown below: 

KEYNOTE_BBA_ASI-KEYNOTE_292423N__ 
1242421E _2_1234_0_0 

The cookie name, KEYNOTE _BBA_ASI identifies the 
cookie so that the customer can recognize it when prompted 
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by the browser whether to accept the cookie. The cookie 
prefix shown is KEYNOTE. The latitude and longitude are 
292423N and 1242421E. The Agent Type ID is 2. The 
provider ID is 1234 and the customer ID and page ID are 
both 0. Using this cookie, the browser agent can compactly 5 
send all necessary y user information to the relay server. 

So far, a system has been described for providing regis- 
tration information to a Geoserver that converts geographi- 
cal information to latitude and longitude, combines the 
geographical information with other identifying information 10 
and returns to the user machine a cookie that can function to 
provide the information as part of an HTTP GET request. 
The following description shows how timing information is 
obtained and sent as part of the HTTP GET request. 

FIG. 4A is a process flow diagram illustrating a process 15 
running on a Web server 402, a browser 404, and a relay 
server 406 for timing the downloading of a Web page. In a 
step 410, the user running browser 404 selects an HTML 
page that contains the browser agent. This results in the 
sending of an HTTP GET request to Web server 402 Web 20 
server 402 then sends back the requested HTML page 
containing the browser agent in a step 420. It should be 
noted here that in different cases, the user may or may not 
realize that he is requesting a browser agent. For example, 
if a Web page provider desires to obtain performance 25 
information about a Web page that it provides, the provider 
could provide the browser agent and frame set in response 
to a user request for the Web page. The browser agent could 
then request the page and, depending on the frame set sent 
along with the browser agent, a visual indication to the user 30 
that the browser agent has requested and is monitoring 
download performance may be provided. In other 
embodiments, the user knowingly selects the browser agent. 
The browser agent may provide to the user a list of pages 
that may be downloaded that arc supported by the browser 35 
agent or the browser agent may automatically select a page. 
If a list is provided, the user selects a page from among a list 
of choices provided by the browser agent. Thus, in different 
embodiments, performance monitoring is done when a user 
selects a Web page that the provider wishes to be monitored 40 
or performance monitoring is done after the user purposely 
requests a browser agent. 

The browser agent is made up of JavaScript functions and 
an HTML Frame set definition. An HTML Frame set is an 
HTML page containing definitions of Frames, or logical 45 
definitions of a single Web page. Each Frame is denned by 
its size, position, and display content Frames may be 
invisible, that is they are not displayed on the screen, or may 
be very small, consisting of only a small point or box, or may 
be large enough to contain text or links to other pages. The 50 
processes running on the browser agent are further described 
in FIG. 6. In a step 430, a hyperlink within the HTML page 
containing the browser agent is selected to download the test 
page and an HTTP GET request is sent as a result. As noted 
above, the test page may also be downloaded automatically 55 
by the browser agent, without the user selecting a hyperlink, 

In one embodiment, the browser agent records the time of 
the sending of the HTTP GET request as the start time. Upon 
receiving the HTTP GET request, Web server 402 sends 
back the requested Web page in a step 440. In a step 450, the 60 
browser agent calculates the download interval, encodes it in 
an HTTP GET request header, and sends the HTTP GET 
request to relay server 406. In one embodiment, the end of 
the download interval is marked using the on load finction. 
In other embodiments, tie browser agent calculates other 65 
performance parameters in addition to or in place of the 
download interval. For example, the time required for the 
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server to send the first byte or to end transmission may be 
measured. It should also be noted that in some embodiments, 
the measurement and reporting functions are placed in a for 
loop so that the web browser repeatedly accesses a Web 
page, making repeated measurements and sending multiple 
reports to the relay server. 

In some embodiments, rather than sending the actual 
download time, the browser agent makes a qualitative 
assessment of the performance and sends the assessment. 
The qualitative assessment may be made relative to an 
absolute scale (eg. less than 2 seconds is performance level 
1 or green, greater than 2 seconds but less than 4 seconds is 
performance level 2 or yellow, and greater than 4 seconds is 
performance level 3 or red) or a sliding scale based on 
average observed performance (e.g. above or below 
average). In certain embodiments, the browser also displays 
the qualitative assessment to the user. Once it receives the 
performance report, relay server 406 returns a blank HTML 
page to browser 404 in a step 460 signifying that the HTTP 
GET request was received, 

As noted above, in this example, the user first selects an 
HTML page that contains the browser agent in a visible 
agent frame and then makes a page selection from this frame 
after receiving the page containing that agent. The resulting 
selection is displayed in the display frame. In another 
embodiment, the user makes only one selection The user 
selects the desired HTML page that he wishes to download. 
The browser agent is sent in response as part of a hidden 
agent frame that is included in an initial HTML page. The 
JavaScript that implements the browser agent then automati- 
cally sends an HTTP GET request to retrieve the desired 
HTML page in the display frame. 

By controlling the sending of the HTTP GET request for 
the desired HTML, page, the browser agent is able to record 
the time the request was sent and monitor the receiving of 
the page to determine the download time. In such an 
embodiment it is possible to record the timing of the Web 
page download in a manner that is transparent to the user. 
The user simply requests a desired page. Instead of receiving 
the page directly, the user first gets a page containing the 
browser agent. The browser then automatically sends the 
request for the desired page and notes the download time. 
The browser agent is thus a powerful tool for providing 
download timing information to a Web page provider. Each 
user who downloads data from the server provides download 
timing information and no additional action or choice is 
required from the user to provide the information since the 
browser agent is provided first in response to the HTTP GET 
request. The browser agent requests the desired page, times 
the download, and sends the download timing information to 
the relay server as part of an HTTP GET request without 
further intervention by the user. 

FIG. 4B is an illustration of a Frame set used in an 
embodiment where a visible agent frame containing links to 
test pages that may be downloaded. A Display frame 480 is 
initially blank. Display frame 480 eventually contains the 
test page that is downloaded. An agent frame 482 is also 
shown as a visible frame, Agent frame 482 condors a set of 
links to test pages that may be downloaded by the browser 
agent and displayed in display frame 480. In this 
embodiment, test pages are not downloaded automatically, 
but instead are selected by the user from the links in the 
visible agent frame. In embodiment where the agent pro- 
vides the test page automatically, the agent frame may be an 
invisible frame or may be only a very small frame that 
functions only as a visual indicator that the frame is there, 
if that is desired. 
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FIG. 5 is a diagram of the fields contained in an HTTP 
GET request header that has been altered to transfer down- 
load timing information to a relay server. The download time 
interval measured by the browser agent is encoded as a 
DELTA field 502. In one embodiment, the DELTA field is an 
integer representing a number of milliseconds. The delta 
field is sent as a variable DELTA in the HTTP GET request 
header. Next, a group,of fields are defined that make up a 
page station identifier (PS I) 503. These include a latitude 
field 504 and a longitude field 506 in 7 character USGS 
format; an agent type ID field 508 that is preferably a 2 byte 
integer; a service provider ID field 510 that is preferably a 
2 byte integer; a customer ID field 512 that is preferably a 
4 byte integer, and a page ID field 514 that is preferably a 
4 byte integer. Customer ID field 510 identifies the owner of 
the page that is being measured and page ID field 514 
identifies the specific page that is measured. Together, the 
page station identifier fields describe the unique combination 
of the HTML page and the server on which the page resides. 
The test page URL is also included in the HTTP GET request 
header in some embodiments as a test page URL ASCII 
variable 516. The test page URL identifies the Web page that 
is downloaded, but not necessarily the server. The customer 
ID and page ID identity the server and the page. 

A sample HTTP GET request header sent by the browser 
agent to the relay server is shown below: 

GET/DELTA-6 61&PSI- 

292423N%5F1242421E%5F0%5F1234%5F1234% 
5F1234&URL=http://ny.us.keynote.com:2989/ 
BBADEV/test.html HTTP/1.0 

The DELTA shown is equal to 661. The page station 
identifier fields are shown delimited by %S (which is the 
underscore character in HTML) within the variable PSI. The 
test page URL is shown as the value of the URL variable. 

At this point, it may be useful to discuss the data that is 
preferably sent to the relay server as part of the cookie file 
and the data that is preferably sent to the relay server as part 
of the PSI or as another field in the HTTP GET request 
header. The cookie file preferably contains information that 
identifies the user and the user's Internet service provider. 
This is advantageous because storing this information once 
in the cookie alleviates the need for the browser agent to ask 
the user for the information. On the other hand, information 
that is either determined by the browser agent (such as the 
DELTA), or that can be included in the browser agent when 
it is sent to the user (such as the customer ID and the page 
ID), is included as a field in the HTTP GET request header. 
Thus, the user does not have to input information that is not 
known to the browser agent but that is in the cookie and the 
browser agent provides the information that it has available 
for the fields in the HTTP GET request header without the 
need for user input. 

In the data structures shown, certain fields from the cookie 
such as latitude field 504, longitude field 506, and service 
provider ID) field 510 ire shown in the PSI. It should be 
understood that these fields are included for the purpose of 
providing flexibility for implementations that do not take 
advantage of a cookie or for implementations that might for 
some reason require that the browser agent obtain this 
information each lime that the browser agent is sent. 
Likewise, certain fields provided by the browser agent in tie 
PSI fields of the HTTP GET header such as Agent type ID 
308, customer ID 312, and Page ID 314 are shown in the 
cookie even though such information would generally not be 
available during the registration process Such fields are 
shown in the cookie again to allow for flexibility of imple- 
mentation. In certain embodiments, the extra fields also may 
be used for other purposes, 
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It should be noted that conventionally, the cookie is only 
sent to the owner of the cookie. The owner of the cookie is 
the party that stored the cookie. In the embodiment 
described above, therefore, the owner of the cookie is the 

5 Geoserver. In one preferred embodiment where the cookie is 
used, the Geoserver is implemented on the same physical 
machine as the Relay server so that the cookie is sent to the 
Relay server with the HTTP GET request. In other 
embodiments, the Geoserver is used to relay the HTTP GET 

10 request to the Relay server. The Geoserver gets the cookie 
and transfers the cookie information to the Relay server, 
This can be done a number or ways, including using the 
fields in the HTTP GET header. Alternatively, it is possible 
for the browser agent to prompt the user for the cookie 

15 information and include it along with the rest of the fields in 
the HTTP GET header. 

Using the data formats described above, it is possible for 
the browser agent to assemble all of the necessary informa- 
tion for communication to the relay server. The cookie 

20 stored on the user machine stores information about the user 
that is provided by the Geoserver. Information about the 
page station that is providing the Web page and which is 
being evaluated for download performance is transmitted 
with the browser agent. Thus, page station information is 

25 provided via the agent and the user need not provide any 
information. Page station information along with measured 
download timing information is provided to the relay server 
via fields in the HTTP GET request header. User geographic 
location information and service provider information is 

30 provided by the cookie. Information about the user is 
provided once in the registration process and stored in the 
cookie so that it is provided along with the HTTP GET 
request sent from the browser to the relay server. 

In certain embodiments, inflation about the user need not 

35 be provided and the browser agent is sent from the page 
station to users whether or not they have registered In such 
cases, users with blank cookies or no cookies are kept track 
of by the relay server in a separate geographical category 
from users whose geographic category and other informa- 

40 tion is known. Information about such users is useful when 
evaluating the generic, system wide performance of a server 
regardless of the location of the user. 

FIG. 6 is a process flow diagram illustrating the process 
implemented on the browser agent for measuring and report - 

45 ing download time. The process starts at 600. In a step 610, 
the agent triggers a start timer. In a step 620, the test page 
is retrieved. Next, in a step 630, a stop timer is triggered by 
the on load function when the test page is loaded It should 
be noted that in other embodiments other events may be used 

50 to trigger the stop timer. In a step 640, the result of the test 
is sent to a relay server. The process ends at 650. 

FIG. 7 is a process flow diagram illustrating the process 
implemented on the relay server. The process starts at 700. 
In a step 710, the relay server receives packets from agents. 

55 In a step 720, data from packets is assembled and formatted. 
In a step 730, the database server is contacted and results are 
sent. The process ends at 740. This, the relay server receives 
actual historical performance data from browser agents. If 
network problems occur, the data from the relay server or the 

60 database server can be used to analyze network performance 
at different times. 

Thus, a method and apparatus for evaluating service to a 
user over the Internet has been disclosed. The method 
disclosed may also be applied to any other network com- 
es puling environment, including public or private interned or 
intranets. Download time, or any other performance param- 
eter that is desired may be measured using an agent that 
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monitors information as it is transmitted between parties. In 
one embodiment, the network is the Internet and the infor- 
mation is transmitted in the form of Web pages. Results are 
preferably sent to a relay server for formatting before being 
stored in a database server. In some embodiments, results are 5 
sent directly to a database server. 

Although the foregoing invention has been described in 
some detail for purposes of clarity of understanding, it will 
be apparent that certain changes and modifications may be 
practiced within the scope of the appended claims. It should 
be noted that there are may alternative ways of implement- 
ing both the process and apparatus of the present invention. 
Accordingly, the present embodiments are to be considered 
as illustrative and not restrictive, and the invention is not to 
be limited to the details given herein, but may be modified 
within the scope and equivalents of the appended claims. 35 

What is claimed is: 

1. A method of gathering information relating to a loading 
time experienced by a user of information over a network 
comprising: 

sending a browser agent to a user machine in response to 20 
a user request to access a Web page, wherein the 
browser agent is operable to log a first time correspond- 
ing to the sending of a user HTTP GET request, 
wherein the browser agent initiates the sending of the 
user HTTP GET request, and wherein the browser 2 5 
agent measures a download time interval, the download 
time interval being determined according to the differ- 
ence between the first time and a second time corre- 
sponding to the loading of the Web page; and 

wherein the browser agent is operative to cause the user 30 
machine to send a modified HTTP GET request, 
wherein the modified HTTP GET request contains a 
performance parameter indicative of the measured 
download time interval; 

whereby the download time interval experienced by the 35 
user is measured and a parameter indicative of the 
measured download time interval is sent as part of the 
modified HTTP GET request. . 

2. A method as recited in claim 1 wherein the browser 
agent is further operative to cause the user to send a user 
information cookie as part of the HTTP GET request, 40 
wherein the user information cookie includes information 
related to the user. 

3. A method as recited in claim 2 wherein the information 
related to the user includes a geographical coordinate. 

4. A method as recited in claim 2 wherein the geographi- 45 
cal coordinate is predetermined according to a city indicated 
by the user. 

5. A method as recited in claim 1 further including 
receiving a plurality of user modified HTML requests from 

a plurality of users and recording a plurality of performance 50 
parameters, the plurality of performance parameters being 
indicative of a plurality of measured download time inter- 
vals determined by each of the plurality of users. 

6. A method as recited in claim 5 further including 
generating a map that indicates the performance experienced 55 
by users in different regions. 

7. A method as recited in claim 1 wherein the modified 
HTTP GET request is generated by the browser agent. 

S. A method as recited in claim 1 wherein the performance 
parameter is the difference between the first time and the 60 
second time. 

9. A method as recited in claim 1 wherein the performance 
parameter is a qualitative evaluation of performance based 
on the difference between the first time and the second time. 

10. A method as recited in claim 1 wherein the second 65 
time corresponds to the completion of the loading of the Web 
page. 



11. A method as recited in claim 10 wherein download 
time interval is equal to the difference between the first time 
and the second time. 

12. A method as recited in claim 1 wherein the network is 
the Internet. 

13. A method as recited in claim 12 wherein the infor- 
mation downloaded is a Web page. 

14. A system for assembling performance data related to 
the downloading of information from a computer network 
comprising: 

a Web server configured to send an browser agent to a user 
in response to a user request, wherein the browser agent 
is operable to log a first time corresponding to the 
sending of a user HTTP GET request, wherein the 
browser agent is configured to initiate the sending of 
the user HTTP GET request, and wherein the browser 
agent is configured to measure a download time 
interval, the download time interval being determined 
according to the difference between the first time and a 
second time corresponding to the loading of the Web 
page; and 

a relay server configured to receive from the user a 
modified HTTP GET request, wherein the modified 
HTTP GET request contains a performance parameter 
indicative of the measured download time interval; 

whereby the download time interval experienced by the 
user is measured and a parameter indicative of the 
measured download time interval is received as part of 
the modified HTTP GET request. 

15. A system as recited in claim 14 wherein the relay 
server is configured to receive from the user as part of the 
HTTP GET request a user information cookie, wherein the 
user information cookie includes information related to the 
user. 

16. A system as recited in claim 15 wherein the informa- 
tion related to the user includes a geographical coordinate. 

17. A system as recited in claim 15 wherein the geo- 
graphical coordinate is predetermined according to a city 
indicated by the user. 

18. A system as recited in claim 15 wherein the network 
in the Internet. 

19. A system as recited in claim 14 wherein the relay 
server is operable to receive a plurality of user modified 
HTML requests from a plurality of users and record a 
plurality of performance parameters, the plurality of perfor- 
mance parameters being indicative of a plurality of mea- 
sured download time intervals determined by each of the 
plurality of users. 

20. A system as recited in claim 14 further including 
means for generating a map that indicates the performance 
experienced by users in different regions. 

21. A system as recited in claim 14 wherein the perfor- 
mance parameter is the difference between the first time and 
the second time. 

22. A system as recited in claim 14 wherein the perfor- 
mance parameter is a qualitative evaluation of performance 
based on the difference between the first time and the second 
time. 

23. A system as recited in claim 14 wherein the second 
time corresponds to the completion of the loading of the Web 
page. 

24. A system as recited in claim 14 wherein the download 
time interval is equal to the difference between the first time 
and the second time. 

25. A system as recited in claim 14 wherein the Web 
server and the relay server are implemented on a single 
physical machine. 



04/22/2004, EAST Version: 1.4.1 



US 6,625,647 Bl 



13 



26. A system as recited in claim 14 wherein the Web 
server and the relay server are implemented on different 
physical machines. 

27. A system as recited in claim 14 wherein the network 

is the Internet. 5 

28. A system for assembling performance data related to 
the downloading of information from a computer network 
comprising: 

a Web server configured to send a browser agent to a user 
in response to a user request to access a Web page, 10 
wherein the browser agent is operable to log a first time 
corresponding to the sending of a user HTTP GET 
request, wherein the browser agent is configured to 
initiate the sending of the user HTTP GET request, and 
wherein the browser agent is configured to measure a 15 
download time interval, the download time interval 
being determined according to the difference between 



14 



the first time and a second time corresponding to the 
loading of the Web page; and 

wherein the browser agent is configured to send a modi- 
fied HTTP GET request, the modified HTTP GET 
request containing a performance parameter indicative 
of the measured download time interval; 

whereby the download time interval experienced by the 
user is measured and a parameter indicative of the 
measured download time interval is sent as part of the 
modified HTTP GET request. 

29. A system as recited in claim 28 wherein the download 
time interval is included in the header of the modified HTTP 
GET request. 

30. A system as recited in claim 28 wherein the network 
is the Internet. 



04/22/2004, EAST Version: 1.4.1 



US -PAT-NO : 6625647 



DOCUMENT - I DENT I F I ER : 


US 6625647 Bl 








TITLE: 


Method and apparatus 
over the internet 


for evaluating service 


to a user 




DATE- ISSUED: 


September 23, 2003 








INVENTOR- INFORMATION : 

NAME 

COUNTRY 

Barrick, Jr. ; James G. 


CITY 

Menlo Park 


STATE 
CA 


ZIP CODE 
N/A 


N/A 


Ge ; Guoqiang 


Mountain View 


CA 


N/A 


N/A 


Zou ; Tong 


Fremont 


CA 


N/A 


N/A 



US - CL - CURRENT : 709/224, 709/219 

ABSTRACT : 

A system and method are disclosed for gathering information relating to a 
loading time experienced by a user of information over a network. A browser 
agent is sent to a user machine in response to a user request to access a Web 
page. The browser agent initiates the sending of a user HTTP GET request and 
the browser agent is operable to log a first time corresponding to the sending 
of the user HTTP GET request. The browser agent measures a download time 
interval that is determined according to the difference between the first time 
and a second time corresponding to the loading of the web page. The browser 
agent is operative to cause the user machine to send a modified HTTP GET 
request, wherein the modified HTTP GET request contains a performance parameter 
indicative of the measured download time interval. Thus, the download time 
interval experienced by the user is measured and a parameter indicative of the 
measured download time interval is sent as part of the modified HTTP GET 
request 

30 Claims, 10 Drawing figures 
Exemplary Claim Number: 1 
Number of Drawing Sheets : 8 



KWIC 



Drawing Description Text - DRTX (10) : 

FIG. 4B is an illustration of a frame set used in an embodiment where a 
visible agent frame containing links to test pages that may be downloaded. 

Detailed Description Text - DETX (6) : 

FIG. 1C is a block diagram of a system for measuring the download time of a 
Web page at a group of client sites. A number of user machines 102a, 102b, and 
102c are connected to a Web server 104. In one embodiment, each user machine 
has a Web browser application running on it that supports JavaScript and HTML 
frames. Browser agents 106a, 106b, and 106c are shown implemented on each of 
the user machines. Each browser agent is a collection of JavaScript functions 
embedded within an HTML page. In various embodiments, browser agents are 
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implemented in JavaScript, Java, or Active. Preferably, browser agents are 
implemented in an apple that may be received as part of an HTML page for 
reasons that are described below in other embodiments, browser agents may also 
be provided as part of an installed browser or a plug- in to a browser that is 
separately downloaded by a user. 



Detailed Description Text - DETX (10) : 

A particularly useful feature included in the download liming system shown 
in FIG. 1C is that all communication between the parts of the system is 
accomplished in a manner that allows for the fact that different user machines 
may be operating behind firewalls with varying levels of security constraints. 
So long as the user machine is able to send HTTP GET requests and download Web 
pages with embedded Java Script, the user machine can communicate within the 
system. During the registration process, the user provides information to the 
relay server and the relay server returns the information to the user in a 
cookie. Storing geographical and other user information in a cookie file 
located on the user machine enables the browser agent to transmit that 
information along with download timing information and other information 
generated by the browser agent in the form of an HTTP GET request to the relay 
server. The browser agent itself is downloaded as part of an HTML page in 
response to an HTTP GET request from the user. 



Detailed Description Text - DETX (22) : 

The browser agent is made up of JavaScript functions and an HTML Frame set 
definition. An HTML Frame set is an HTML page containing definitions of 
Frames, or logical definitions of a single Web page. Each Frame is defined by 
its size, position, and display content Frames may be invisible, that is they 
are not displayed on the screen, or may be very small, consisting of only a 
small point or box, or may be large enough to contain text or links to other 
pages . The processes running on the browser agent are further described in 
FIG. 6. In a step 430, a hyperlink within the HTML page containing the browser 
agent is selected to download the test page and an HTTP GET request is sent as 
a result. As noted above, the test page may also be downloaded automatically 
by the browser agent, without the user selecting a hyperlink, 



Detailed Description Text - DETX (27) : 

FIG. 4B is an illustration of a Frame set used in an embodiment where a 
visible agent frame containing links to test pages that may be downloaded. A 
Display frame 480 is initially blank. Display frame 480 eventually contains 
the test page that is downloaded. An agent frame 4 82 is also shown as a 
visible frame, Agent frame 4 82 condors a set of links to test pages that may be 
downloaded by the browser agent and displayed in display frame 480. In this 
embodiment, test pages are not downloaded automatically, but instead are 
selected by the user from the links in the visible agent frame. In embodiment 
where the agent provides the test page automatically, the agent frame may be an 
invisible frame or may be only a very small frame that functions only as a 
visual indicator that the frame is there, if that is desired. 



Detailed Description Text - DETX (28) : 

FIG. 5 is a diagram of the fields contained in an HTTP GET request header 
that has been altered to transfer download timing information to a relay 
server. The download time interval measured by the browser agent is encoded as 
a DELTA field 502. In one embodiment, the DELTA field is an integer 
representing a number of milliseconds. The delta field is sent as a variable 
DELTA in the HTTP GET request header. Next, a group, of fields are defined that 
make up a page station identifier (PSI) 503. These include a latitude field 
504 and a longitude field 506 in 7 character USGS format; an agent type ID 
field 508 that is preferably a 2 byte integer; a service provider ID field 510 
that is preferably a 2 byte integer; a customer ID field 512 that is preferably 
a 4 byte integer, and a page ID field 514 that is preferably a 4 byte integer. 
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Customer ID field 510 identifies the owner of the page that is being measured 
and page ID field 514 identifies the specific page that is measured. Together, 
the page station identifier fields describe the unique combination of the HTML 
page and the server on which the page resides. The test page URL is also 
included in the HTTP GET request header in some embodiments as a test page URL 
ASCII variable 516. The test page URL identifies the Web page that is 
downloaded, but not necessarily the server. The customer ID and page ID 
identity the server and the page. 



Detailed Description Text - DETX (30) : 

The DELTA shown is equal to 661. The page station identifier fields are 
shown delimited by %5 (which is the underscore character in HTML) within the 
variable PSI . The test page URL is shown as the value of the URL variable. 



Detailed Description Text - DETX (36) : 

FIG. 6 is a process flow diagram illustrating the process implemented on the 
browser agent for measuring and reporting download time. The process starts at 
600. In a step 610, the agent triggers a start timer. In a step 620, the test 
page is retrieved. Next, in a step 630, a stop timer is triggered by the on 
load function when the test page is loaded It should be noted that in other 
embodiments other events may be used to trigger the stop timer. In a step 640, 
the result of the test is sent to a relay server. The process ends at 650. 
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